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ABSTRACT 

The problem of blocking on a status variable was 
investigated.; The one-way fixed-effects analysis of variance, 
analysis of covariance, and geT«ralized randomized block designs each 
treat the "blocking problem in a different way. In order to compare 
these designs, it i. »?ecessary to restrict attention to experimental 
situations in which ob^erv^jtions are collected within a fixed-effects 
generalized randoisi'*. ^ l^loc*? framework. An analytical tecjnigue. was 



developed to aid a recchr 
The technique is based on 
particular treatment mai n 
levels. (Author) 



1 er in choosing obe of these three designs, 
the criterion of maintaiixing' power against 
effect non-nullities, at certain, specif ied 
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Host of us r#gard experimental design as an Integral part of re- 
search « Prior to Initiating an experimental manipulation we consider 
yarioud alternatives with respect to the potential utilisation of factors 
believed to be systematically related to the dependent variable. In 
particular » we conceive ^sampling plan that reflects our research 
objectives and that allows efficient data analysis. / 

When designing experiments pertaining to the comparison of specified 
treatments > a researcher in the behavioral sciences is often faced with 
the problem of choosing one of several' experimental designs* If the 
presence of a non-treatment nuisance factor is anticipated » the simplest 
designs under consideration are likely to be the completely randomised » 
the generalized randomized block, and the analysis of covariance designs. 
Each of these designs retires a fundamentally different way of dealing 
with a potential nuls^r^e factor. 

Consider a comparative study in which an investigator wants to 
deteiTBlne the effect of each of . three different instructional methods *on 
achievement. Before performing the xperlment he may consider the use of 
the one way fixed effects analysis of variance mcdel and question the 
wisdom of controlling a potentially troublesome secondary factor^ such 
as I.Q. Lack of control may result in Substantial loss of power of the 
statistical test Involving treatment differences. On the other hand^ 
ImplcnDentation of controls may require additional subjects and greater 
expense. This paper describes an analytical method for making a choice 
aoiong the one way fixed-effects » the generalized randomized blocks and 
the analysis of covariance designs. 

The sampling plan adopted for the study consists of sampling subjects 
from fixed I.Q. levels (or blocks) and randomly assigning them Co treat- 
ment conditions witliin blocks.* In tfiis manner the one-way and the aitalysis 
of covariance models may be conceptualized as special cases of the generalized 



tand'^mized block model and the rei»ulting design comparison Is facilitated. 

Table 1 depicts the three options under consideration. Option 1 
represents a decision to ignore the I.Q. factor. The corresponding 
model consists of the grand mean parameter u)^ the treatment effect 
parameter a^, and the discrepancy, c^^, between the observed and predicted 
values of the criterion score. 

Option 2 represents a decision to incorporate I.Q. as a covariate. 

In addition to m and the model contains a criterion component 

* tlx 
S(X ~ X) where X., is value of the covariate for the j subject In 
ij 

the 1^^ treatment and 6 is the slope of the regression of the criterion 
score on the covariate score X^^ . The model also contains the 
dlscrepency, , between the observed and predicted values of the 
criterion score. Note that 'the result of removing the component 
0(X^. - X) from the one way model error term, £^j, is c^. 

Option 3 represents a decision to Incorporate I.Q. as a blocking 
factor." In addition to u and a^, the model contains the I.Q. effect 
parameter By the treatment by I.O. interaction effect parafijeter y^y 

and the dlscrepency, c , , between the observed and predicted criterion 

i jK 

scores. 

Under what circumstances might an investigator be led to prefer 
one of * the three desigria to the remaining two? First, the anticipated 
presence of substantial treatment by block interaction effects, y^y 
and/or substantial 'non-linear block effects, (B^ - e(X^j - X)}, clearly 
suggest thfe use of the generalized randomized block design. Secondly, 
the anticipated absence of treatment by block interaction effects and 
non-linear block effects, in conjunction with the anticipated presence 
of substantial linear block effects. 6(Xj^^ - X), suggest the use of 
the analysis of covariance design. Finally, the anticipated absence of 
both treatment by block interaction effects and block main effects 



\ 



suggest the use of the one way design. 

The relative magnititude^ of the afore mentioned effects may be 
combined to form several higKly useful indices. The first is a blocking 
index, m. (equation 1) reflecting the magnitltude of block main effect 
and/or treatiaent by block interaction effect variance relative to error 
variance. * 

2 2 

, . ^ (i> 

• la the finite population variance due to block effects, o^^ Is the 

finite population variance due to treatment by block interaction effects, 
•and is the error variance in the generalized randomized block model. 
^ The blocking index, m. assumes values between 0 and 1. Clearly, when 
n is close to 1. the use of the * one way design la inappropriate. 

The second index, k, is a covarlance index (equation 2) reflecting the 
magnitltude of the linear block effect variance relative to the block 
within treatment effect variance. ^ 

, _ (2; 
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is the finite population variance due to linear block effects. The 
civariance index, k. also assumes values between a and 1. Whet( k is close 
to 1 and m is sufficiently different flrom 0. the use of the analysis 

of covarlance design is appropriate. \ 

/ T y ^^Error 

Next, let us turn our attention /o the test statistic. F- — / 

/ ° T / Error 

(equation 3) that is used in tes^^g the hypothesis that the treatment ^ 
effects are null. The denominator consists of a different sua of 
squares term depending upon the choice of model. 
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Under the generalized randomized block models the test statistic 
ia distributed in general as a noncentral F random variable (equation 4). 

"^{df^ df„ 6^} 

Error, T (4) 

2 

where is the treatment effect noncentrality parameter. 

Under the analysis of covarlance model, F is {distributed as a 
doubly noncentral F random var;lable (equation 5) . 

^ ' "'"t. "Error. 4. W 

wher^ 6^ is the noncentrality parameter associated with the non-linear 

2 

block $nd treatn^nt by block interaction effects. Note that 5^ my be 
expressed as a function of m and k, the blocking and covarlance indices ^ 
respectively. » 

Under the one way model, F is distributed as a doubly noncentral 
F random Variable (equation 6) . 

^{df^ df^ 4 «^ ' 

T; Error, T, c 

2 

where 5 ia the noncentrality parameter associated with the block main 
effecta and treatment by block interaction effects. Note that 5 may 

• ^ 

be expressed as a functi ^n of m, the blocking index. ^ 

The power function of the test of treatment differences (Figure 1) 
is substantially dependent upon the choice of model by virtue of the 
noncencrality parameter associated with the block and treatment by 
block effects. Therefore, to facilitate comparisons among the three 
designs^ It. is stipulated that certain power requirements be met, regardless 
of the model chosen. Figure 1 illustrates that an amoun of power 
is desired against a treatment effect non-nullity of magnitltude and an 
amount of power P^- ia desired against A2, where Aj is the upper bound 
on the set of non-nullities that the investigator has decided are trivial 
and vhere A2 ia the lower bound on the set of non-nullities that he has 
decided are Important • 



BESI COM MAllJ*^ 

^ * 

A computer program is used to calculate the value of the type I 

r 

error rate, a, and the sample size, N, corresponding .to the "power 
functi6n in figure 1. Different values of a and N are obtained depending 
upon the choice of model. 

Ck>naideythe data in Table 2. An investigator is testing a 
hypothesis about a linear trend among the treatments (say) and wishes 
to include a blocking variable consisting of 8 levels. The solutions 
for a and N required by the generalized randomized block model are 
.0604 and 36.39 respectively. The solutions required by the one way 
model are .0630 and 24.00 respectively. 

The one way model appears to be more economical if no block within 
treatment variability is present, that is to aa> if m-0. However, to 
the extent that m la nonzero, the desired power function is depressed 
when the one way model is used. An obvious remedy is to Increase the 
number of subjects beyond 24 in order to meet the 8peclfle4 power 
criteria. However, to increase the number beyond 36 is pointless because 

' the generalized randomized block model, whose power function is independent 
of m, may be used. In fact, it seems that If one expects an m value 

,^ln excess of 8% on? ought to uSe the generalized block model. The 
reason la simply that too many subjects are required by the one way 
model in order to meet the specified power criteria. 

Let m represent the largest m value that may b^ tolerated by a 
researcher using a one way model. A value less than m is acceptable 
since the power criteria are satisfied but a value greater than m is 
unacceptable since the power criteria are not satiafiatl. The tabled 
values of m* for a number of sample size values range from 6% to 8%. 
The implicatlcftv is clear, very little block within Lireatment variability 
is required befora the researcher is led to incorporate the blocking 
factor in the design. 
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All of Che data collected thud tar strouftly ^iupports an investigator 
who Incorporates a blycking factor into' the design whenever block inain 
effects or treatment by block interaction effects expected to exceed 
minimal levels. Table 4 represents the moat extreme case with respect 
to m* magnitltudcs encountered to date. 

Table 5 represents «* values corresponding to various sample size 
and covariance, index values, derived from the initial data in 'table 2. 
For example, an N value of 36.39 and a k value of .67 yields an m 
value of 20%. A researcher expecting bl-ock within treatment variability 
leading to an m* value in excess of 20% would choose the generalizeu 
randomized block design. On the other hand, expecting a Vftlue less 
than 20% leads to the choice of the analysis of covarlance design. 
Table 6 also represents m* values and is derived from initial data in 
table 4. 

In sujamary, the strong recoxnmendatlon based on this research Is 
"Wheo In ioubt, bloQk; it is almost always to your advantage". 
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Table 1 

Design Decisions 
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Beeeerehcr** objective Is to teat & hypothesis eoQcexnliig treetaent 
differences* Bis design question centers on the aanner in ufalch to 
hendle e nuisance factor. (The latter is a factor related to the de< 
pendent variable and one In «hlch the researcher has no Interest.) 



Option 1 

Ignore that nuisance factor 
EKsnple : 



Model 



1 factor design consisting of 
3 treatasnt eoaditiooa 



Option 2 

^ Incorporate the nulsanca. factor into the design as a cover late 
Model - V +,Oj^ 4. 0(X^^ - X) 4- cj^ 

Mote: «^ • c^j - - ^ ^ 

Option 3 

Incorporate the nuisance factor into- the design ss a blocking factor 



EKawple ; 



1^ 



h 
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3 levels of traatjMt factor 

4 levela of nulaance factor 



Model 
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TABLE 2 



y Design: A treatatot conditions 

^ 8 Revels o£ blocking'^ variable 

Power ^ction specification: 

and.= Pj^ ^» .1» and 
- - l.lJtf aiad . - .9 

Sample size and a v^luesyi ^ 

GBB design N - 36.39 and a > .0604 and 

OW design N - 2A.00 and a ^ .6630. 



•j-i . 

AM; - ■ 





* 

a Values 


36i39' 


.08 


33.91 


.08 


31.44 


.07 


28.96 


.06 


26.48 


.06 
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TABLE 3 



Design: 3 treatment conditions 

5 levels of blocking variables 

Power function specifications: 

ti - .25 and » .1, and 

A2 - 1.20 and Pj - .9. i 

Sampie aiz^ and a values: 

GRB design K ■ 47.47 and a m .0469, and 

: 5 ' W'ddSlgh N -.46.53 and d - .0472 



47.47 
47.28 
47.09 
46.90 
46.71 



ffi Values 



.01 
.01 
JOl 
<.01 
<.01 
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Blocking Index 
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B BT c 



2 

finite population variance due to block effects 

2 

®BT finite population variance due to treatment by block interaction 
effects 

2 

°£ error variance in the generalized randosised block (GiB) aodel 



Covarlance index 

2 



k. ^ 



^B-'^BT 

2 

finite population variance due to linear block affects 



Error/ * • 

Error 

F - p { df ^ df „ C y 

T , Error T ^ 

2 

*t treatment effect noncentrality parameter 
F - F ( df^_ df «'„) 

non-linear block + treataent by block interactJjOn effect 
noncentrality pajraneter 

^ ■ ^ { ^^T. Error. 4, 'l) 

*€ block «ain + treat, by block Interaction effect noncentrality paraaeter 

i 



4- 



Trivial 



Important 



Figure 1 



TABLE 4 

Design: 8 treati£nt conditions 

4 levels of blocking variable 

Fewer function specifications: 

Ai • .25 and ?^ • .1, and 
• 1.50 and - .9 

Sample size and a values: 

GRB design N » 35.43 and a • .0582 

0^ design N - 20.39 and a * .0629 
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N 



R 

35.43 
32.43 
29.42 
26.41 
23.40 



m Values 

.18 
.17 
.16 
.15 



^TABLE 5 
m Values 



N 


k-.33 


k-.50 


k-,67 


36.39 


.11 


.14 


.20 


33.91 


.11 


.14 


.19 


31.44 


.10 


.13 


.18 


28.96 


.09 


.12 


.17 


26.48 


.08 


.11 


.15 



TABLE 6 
Values 



1 N 


k-.33 


k-.50 


k».67 


35.43 


.24 


on 


.39 


32.47 


.24 


.30 


.38 


29.50 


.23 


.29 


.38 


26.53 


.22 


.27 


.36 


23.57 


.21 


.26 
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